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Abstract 

This draft concerns the error analysis of a collocation method based on 
the moving least squares (MLS) approximation for integral equations, which 
improves the results of [2] in the analysis part. This is mainly a translation 
from Persian of some parts of Chapter 2 of the author’s PhD thesis in 2011. 


1 Introduction 

In [2] a meshless method based on the moving least squares (MLS) was applied 
for integral equations of the second kind, and an error analysis was presented for 
Fredholm integral equations. Here a more interesting presentation of the MLS ap¬ 
proximation and its error estimation are reported, and the analysis of the MLS 
collocation method for Fredholm integral equations of the second kind is revised. 
The analysis is mainly based on the excellent book [1]. 

2 MLS approximation 

Let C for positive integer d, be a nonempty and bounded set. Assume, 

V = {xi,X2, . . . ,XAr} C Q, 

is a set containing N scattered points. The fill distance of X is dehned to be 

hxn=sur) min lla: —xdU, 
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and the separation distance is defined by 

1 

qx = - mm \\xi - Xj\\ 2 . 

A set X of data sites is said to be quasi-uniform with respect to a constant Cqu > 0 

if 

qx ^ hx,n ^ Cq^qx- (1) 

Henceforth, we use for m G No = {n G Z, n ^ 0}, as the space of d-variable 
polynomials of degree at most m of dimension Q := A basis for this space is 

denoted by {pi,... ,pq} or {pa}o^\a\^m- 

A set X = {xi,... ,xx} C with N ^ Q is called P^-unisolvent if the zero 
polynomial is the only polynomial from that vanishes on X. 

The MLS provides an approximation Su,x of u in terms of values u{xj) at centers 
Xj by 

N 

u{x) ~ Su,x{x) = ''^^(l)j{x)u{xj), X E fl, (2) 

i=i 

where (pj are MLS shape functions given by 

Q 

(pjix) = W{X, Xj) ^ \k{x)pk{Xj), 
k=l 

where the influence of the centers is governed by a weight function Wj{x) = w{x, xj), 
which vanishes for arguments x, Xj G hi with ||a; —a;j ||2 greater than a certain thresh¬ 
old, say 6. Thus we can define Wj{x) = K{{x — Xj)/5) where X : —)■ M is a 

nonnegative function with support in the unit ball -8(0,1). Coefficients \k{x) are 
the unique solution of 

Q 

Afc(a;) Wj{x)pk{xj)pi{xj) = pe{x), 0 ^Q, 

k=l j&J{x) 

where J{x) = {j : ||a; — a;j ||2 ^5} is the family of indices of points in the support of 
the weight function. In vector form 

(f>{x) = W{x)P^{PW{x)P^)-^p{x), 

where W{x) is the diagonal matrix carrying the weights Wj{x) on its diagonal, P is a 
Q X ifJ{x) matrix of values Pk{xj), j G J{x), 1 ^ k ^ Q, and p = (pi,... ,Pq)'^ ■ In 
the MLS, one finds the best approximation to u at point x, out of with respect 
to a discrete norm induced by a moving inner product, where the corresponding 
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weight function depends not only on points Xj but also on the evaluation point x 
in question. Note that, if for every x E Q the set {xj : j G J{x)} is PJ^-unisolvent 
then A{x) = PW{x)P'^ is a symmetric positive definite matrix. More details can 
be found in Chapter 4 of [1]. In what follows we will assume that K is nonnegative 
and continuous on and positive on the ball 5(0,1/2). In many applications we 
can assume that 

K{x) = ip{\\x\\ 2 )., X e R'^, 

meaning that is a radial function. Here ip : [0, cxo) —)• R is positive on [0,1/2], 
supported in [0,1] and its even extension is nonnegative and continuous on R. If we 
assume that K G C'^(R'^) then (pj G where n = min{fc,m}. This implies that 

Su,x £ 

It is well-known that [1] if X = {xi,... ,XAr} is a quasi-uniform set in H C R^, 
where H is a compact set and satisfies an interior cone condition, then the MLS shape 
functions {pj} provide a stable local polynomial reproduction of degree m G Mq on 
H, i.e. there exist constants ho,Ci,C '2 > 0 independent of X such that for every 
X G H 

1- (l>j{x)p{xj) = p(x), Vp G P^, 

2- ^ Cl, 

3. pj{x) = 0 if ||x - Xj \\2 > 5 = 2C2hx,n, 
for all X with ^ Iiq. 

Note that, a set H C R'^ is said to satisfy an interior cone condition if there exist 
an angle 9 G (0,7r/2) and a radius r > 0 such that for every x G H a unit vector 
^(x) exists such that the cone 

C(x,^,0,r) ■.= [x + ty.y e R^, \\y \\2 = l,y^^ ^ cos9,t G [0,r]} 
is contained in hi. 

The following theorem shows that the MLS approximation converges uniformly 
for continuous functions on compact domain hi. 

Theorem 2.1. Suppose that H C R'^ is compact and satisfies an interior cone 
condition. The MLS approximation Su,x converges uniformly for all continuous 
function u, as hx,n goes to zero for quasi-uniform sets X. 

Proof. For a fixed x G hi, suppose that po is the constant polynomial with po{x) = 
u{x). The conditions of Theorem ensure that the MLS shape functions provide a 
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stable local polynomial reproduction. 

\u{x) - = 


Thus we can write 

N 

Po(x) -'^(/)j(x)u(xj) 


N 


= 

^'^(j)j{x){po{Xj) -u 



J=1 



N 


< 

^\(j)j{x)\\po{Xj) -u 

>i)| 


i=i 


< 

C^ill'U Po ||oo,.B(a:,(5)nn 


= 

C\ max \u{y) — u 

(x)! 


y€iB(x,S)n^ 


< 

Ciuj{u^ 5), 



where lj(u, S) is the modulus of continuity of u. The compactness of hi and 6 = chx,n 
give the uniform convergence. □ 

Finally, the following error estimation can be proved for smoother functions. 
Note that a domain with a Lipschitz boundary, automatically satisfies an interior 
cone condition. The reader is referred to |3] for proof. 

Theorem 2.2. Suppose that Q, (Z is a compact set with a Lipschitz boundary. 
Let m be a positive integer. IfuE there exist constants C > 0 and Lq > 0 

such that for all X = {xi,... ,xn} C with hx,n ^ ho which are quasi-uniform 
with the same Cqu in m, the estimate 

\\u — Su,x||loo(o) ^ Chx~^ ll'^ll 

holds. 

In numerical implementation, for computing the MLS approximation at a sample 
point x G n, the shifted and scaled polynomial basis functions 

j {x — a;)“ I 

i^sr j 

J 0<a<m 

are used as a basis for P^. In fact we change the basis functions as the evaluation 
point is changed. This leads to a more stable algorithm. For example, the use of 
shifted and scaled basis functions overcomes the instability of the reported results 
in Tables 1, 4 and 6 of [21 Section 6] for quadratic basis functions. 
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3 The MLS collocation method 

A Fredholm integral equation of the second kind can be written as 

\u{x) + / k{x, s)u{s)ds = f{x), X E Q C. (4) 

Jn 

where u is an unknown function, A is a real parameter, hi is a compact domain in 
/ is a given continuous right-hand side function, and k is a given continuous kernel 
in n X n. The above integral equation can be written in the following abstract form, 

(A - J^)u = /, 


where 


Tu= / k{x, s)u{s)ds. 

Jq 

We consider a set of trial points X = {xi,X 2 i ■ ■ ■ ,xn} C hi with £11 distance hx,n- 
Regarding the previous section, we assume that X is a quasi-uniform set and admits 
a well-defined MLS approximation. Suppose that 0i,...,0Ar are the MLS shape 
functions constructed by polynomial space and weight function K G 
A; G Mq. Define 


Vn ■■= span{0i,... ,0Ar}, 


as a finite dimensional subspace of C(r2). According to (|2]), the MLS approximation 
u := Su^x of u is 

N 

u ^ (j)ju{xj) G Vat. 

Moreover, we define a projection operator Vn ■ C(r2) i—)■ Vn which interpolates any 
continuous function into Vn on test points Y = {yi,... ,|/m} C D . More precisely, 
for all M G C(r2) we define 


N 

Vnu := ^ with VNu{yi) = u{yi), 1 <i <M. 
i=i 

In what follows, we let M = and we assume that, the distribution of both sets 
of test and trial points are well enough to ensure the non-singularity of <FAr = 
If it happens then Vn is well-defined. Since u G Vn, we simply have 
Vnu = u. Replacing u by u in (|1]) we get 


N 


E 


A0j(x)-1- / k{x, s)4>j{s)ds 

Jq 


U[Xi 


f{x) +r{x), 
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where r{x) is the reminder. In the collocation method we assume that the reminder 
is vanished at test points Y, i.e. 

Vnt = 0, 


which leads to 


N 


E 


^jiVi) + 



K{yi,s)(f)j{s)ds 




l<i<N, 


or in an abstract form 

VN{\-J^)u = VNf. 

According to the property Vnu = u, we have 


{X-VNJ^)u = VNf. 


The involved integral can be treated by a numerical quadrature of the form 


Qn 


In 


g{s)ds ^^g{Tk)uJk, geC{n), 


(5) 


k=l 


where {r^} and {oJk}, ior 1 < k < Qn are integration points and weights, respec¬ 
tively. We assume that for all G C(f2) the quadrature converges to the exact value 
of integral as Qn increases. Now we dehne 

Qn 

ipNuQ) n{x,Tk)u{Tk)u;k, x G fl, u E ( 6 ) 

k=l 

If we replace IFu by J^nu, we will get 


N 


E 


Qn 

k=l 


Hj fiyi)y 


l<i<N, 


(7) 


where Uj are the approximation values of u{xj). Solving the linear system of equa¬ 
tions d?]) gives the values Uj, j = I,... ,N, and hnally one can approximate 

N 

u{x) ~ Un{x) = (f)j{x)Uj, 
i=i 


for any x E Q. The abstract form of equation ([7]) is 


'Pv(A — J^n)un = VnI- 
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Since mat G Vn-, we have VnUn = un and the above equation can be rewritten as 


(A — Vn^n)un — 'PnI 


( 8 ) 


which shows that the scheme is a discrete collocation method [T]. Consequently an 
iterated discrete collocation solution can be obtained. For this purpose we set 

vn{x) = j[f{x) + TnUn{x)], Vx G Q, (9) 

and by applying the operator Vn on both sides of ([9]), and using the relation ([H]) we 
simply have 

VnVn = Un- 


Thus we conclude 

(A — iFN'PN)uN = f- (10) 

Equations ([8]) and flTOl) will be referred in the next section when we will try to give 
the error bounds for u — un and u — vn- 

Usually and in this paper the case M = N is assumed which leads to a square 
hnal linear system. In addition we can assume that X = Y. The case M > N is 
called oversampling which may help if there is a problem with solvability. 


4 Error Analysis 

As we discussed in the previous section, the method is a discrete collocation, and the 
solvability of the integral equation (|1]) and some insights on integration operators 
Xn and projections Vn are required to obtain the hnal error bound. Moreover, an 
error bound for the MLS approximation should be invoked. 

According to (E]) we dehne 

Km 

IIJAII -.= \ukK{x,Tk)\. 

k=l 

A direction which makes the analysis possible is to seek for characteristic properties 
of operators Vn which imply 

II — Juv)-F|| —>■ 0, II — J^7v)-FAr|| ^ 0, as N ^ oo. (11) 

For this, we assume that {Vn, -A^ > 1} possesses the following properties: 

1. A is a Banach space, and V and Vn, for iV > 1, are linear operator on X into 

A. 
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2. ^ as iV —)■ cx), for all u ^ X. 


3. The set {-Tat, iV > 1} is collectively compact which means that {-Tatm, N > 
1 , ||w|| < 1 } has a compact closure in X. 

Then {-Tat} is said to be a collectively compact family of pointwise convergent op¬ 
erators. According to [H Lemma 4.1.2], if {Tn, > 1} is a collectively compact 
family of pointwise convergent operators, then fllip is satisfied. Finally, [U Theorem 
4.1.1] paves the way for hnding the hnal error bound. 


Theorem 4.1. Let X be a Banach space, let S and T he hounded operators on X to 
X and let S be compact. For given A 7 ^ 0, assume X — T : X which implies 

(A — T)~^ exists as a bounded operator on X to X. Finally assume 

|A| 


ll(r-5)5|| < 


( 12 ) 


then (A — 5)“^ exists and it is a bounded operator from X to X. In fact, we have 

i + ll(A-r)-i 


U (A — T)w = f and (A — S)z = f, then 


(13) 


w - 2^11 < ||(A - iS) ^IIIITw - 


(14) 


Now we go back to equations (IH]) and (1T0|1 . In section 3.4 of [T] it is proved that 
the existence of the inverse operators (A — IFnFn)~^ and (A — Pv-Ta?)”^ are related 
to each other. If (A — Pv-^Af)~^ exists, then so does (A — IFn'Pn)~^ and 

(A - FnVnV = ~ VnJ^nY^Vn]. 

Conversely, if (A — IFnFn)~^ exists, then so does (A — and 

(A - VnJ^nY' = “ WnY'^n]. 

By combining these, we also have 

(A — VnJ^nY^'^n = Fn{X — IFnVnY^- 

We can choose to show the existence of either (A — IFnVnY^ (A — Fn^^nY^ 
whichever is the more convenient, and the existence of the other inverse will follow 
immediately. 

To use the results of Theorem 14.II for schemes ([ 8 ]) and ffTOj) . we should hrst prove 
that {IFnFni > 1 } is a “collectively compact family of pointwise convergent 
operators”. To this aim, we need a uniform bound for ||PAf||- 
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Lemma 4.2. Assume that 0i,...,0Ar are the MLS shape functions on the quasi 
uniform set X = {xi,..., xat} with fill distance hx,n on a compact domain which 
satisfies an interior cone condition. If ||4)^^||oo = 0{1) independent of N (or hx,n), 
then there exists a constant cp independent of N such that WVnW < cp, and Vnu —)• u 
uniformly for all u G C(fi). 


Proof. First 

N 

Vnu{x) = ^ (t)j{x)cj, and VNu{yi) = «(?/*), I <i<N, 
i=i 

give c = On the other hand we have 

N 

II^TVmIIoo < ||c||oomax V |0j(x)| < Oi||$]^^|1oo||m||oo- 

3 = ^ 

The last ineqnality is satished becanse of the Li stability of the MLS shape fnnctions 
(the second property of a stable local polynomial reproduction). Thus we can write 

\\T> II ll'^Af'^lloo , ^ iias-iii 

\\Vn\\ = sup —f—- < Oilld)^ Iloo, 

ugC(r2) Halloo 

which leads to 

Cp := sup IIPatII < cxD. (15) 

N 

Finally, if u is the MLS approximation of u on X then 

II N'O IIoo — \\^ N’O P V^IIoo T 11^ ^||cx) 

< (1 + Cp)\\u - m||oo 

< 0(1 + cp)a;(M, hx,vt) 

In the hrst inequality we have used Vnu = u, and in the last one we have applied 
Theorem 12.11 Since the points are quasi uniform, X —)■ oo implies hx,n —^ 0 and 
VnU —)■ M, uniformly. □ 

Remark 4.3. Experiments show that ||*hjvl|oo is of order 1 independent of the fill 
distance hx,n even if M = N. But it remains to prove this assertion, theoretically. 

In the following lemma we prove that under some conditions {XnPn, > 1} 
is a collectively compact family of pointwise convergent operators. 

Lemma 4.4. Assume that {Xn, N > 1} is a collectively compact family of pointwise 
convergent operators on X = 0(fl). Then {XnPn, N > 1} is a collectively compact 
family of pointwise convergent operators on X. 
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Proof. From (fT^ we have cp = sup \\Vn\\ < oo. The pointwise convergence of 
implies that cp = sup H-FatH < cxo. Together, these imply the uniform boundedness 
of {J^n'Pn} with a bound of cpcp- For the pointwise convergence on C(f2) we have 

\\J^u - J^nTnuHoo < ll-Tu - JatmIIoo + \\J^n{u - Vnu)\\oo 

and the convergence now follows from that of {J^nu} and {Vnu}. To prove the 
collective compactness of {J^n'Pn} we must show that 

^ = {J^n'PnU : N > 1, ||m||oo < 1} 

has a compact closure in From (IT5ll we have 

JC C {J^nU : N > 1, ||m||oo < Cp} 

which proves the assertion because {-Fat} is collectively compact. □ 

Now (fTTj) is satished by replacing by Tn'Pn, and we can apply Theorem 14.11 

Theorem 4.5. Let Q <Z be a compact set with a Lipschitz boundary, and the quasi 
uniform set X = {xi ,..., xat} C be a set of trial points with fill distance hx,n- Let 
{Vn} be a family of interpolant operators from C'(ff) to Vjq = span{0 i,..., cf^} on 
test points Y = {yi,. .., j/w} C ff, where (fj are the MLS shape functions based on 
X and polynomial space P^. Assume that the distribution of points is well enough 
to ensure the non-singularity of and ||<h]^^|loo = 0(1). Further, assume that 
{J-Af} in IjiS}) is a collectively compact family of pointwise convergent operators on 
C(ff). Finally, assume that (A — X)u = f is uniquely solvable for all f G C(f2). 
Then for all sufficiently large N, say N > Nq, the operator (A — FatFat)”^ exists 
and it is uniformly bounded. In addition, for the iterative solution vn for equation 
(A — Xn'Pn)vn = f we have 

\\u - UtvII oo ^ Ci{ \\Xnu - Xu\\oc + cf{1 + cp)Ch^-^^\\u\\ 

provided that u G and for the discrete collocation solution of equation 

(A — VnXn)un = Vxf we have 

\\u-un\\oc < cj{cp\\F'nu - XuWoc + {I + CpCf)cf{ 1 + Cp)Chf}'^^\\u\\y^,^+l^^^} , (17) 
where cj < oo is a bound for (A — FatFat)”^. 
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Proof. According to the assumptions and using Lemmaconclude that {J^n'Pn} 
is a collectively compact family of pointwise convergent operators. By Lemma ?? 
and the discussions after that, we have 


\\{J^ — m'Pn)J 'II —t 0 . 


Thus, flT^ is satished for > A"o if we insert T = T and S = J^nVn in to Theorem 
14.11 Since (A — J^)u = / is uniquely solvable we have (A — J^)~^ < Cq < oo. On the 
other hand ||J^ArPAr|| < cpCp. Consequently, flT^ implies 


II (A - J'n'Pn) II < sup 


1 + CQCpCp 


n>Nq |A| — colKT — P'n'Pn)J^n'Pn\ 


:= Cl < oo. 


which proves the hrst assertion. If we set w = u and z = vpf in (1TT|) then 


||n - nTvIloo < ||(A - J^N'PNy^WWJ^u - J^n'PnuW^ 

< ci{\\J'u- J^nuIIocP ||-^7v(n-^vn)||oo} 

< Ci{\\J^U - J^nuWoo + Cf\\u - Vnu\\oo} 

< Ci{\\J^U - JatmIIoo + cf(||m - m|1oo + WVnu - Pv^lloo)} 

< Ci{\\J^U - J^nuWoo + Cf(1 + Cp)\\u - m||oo} 

— C/jllJ^U — -TvwIIcxd + Ci;’(l + Cp)Ch^'^ ll'^llw^+hO)}‘ 

The last inequality is implied by ([3]). Moreover, 


u — un = u — VnVn = {u — Vnu) + Vn{u — uat), 
Vj nTylloQ ^ ||n P vn II oo ~t~ op||u n/y|[ oo 


lead to (1T7|1 . □ 

Theorem 14.51 shows that, both the quadrature and the MLS approximation error 
bounds affect the hnal estimation. If for a sufficiently smooth kernel k(x, s) a high 
order quadrature is employed then the total error is dominated by the error of the 
MLS approximation. For numerical results see [2]. 
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